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(54) SURGERY SUPPORT DEVICE 
(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a surgery 
support device providing mental stability during surgery 
to prevent breaking of the support device and errors in 
the operation and selection of a surgical instrument 
SOLUTION: The surgery support device provided with 
the surgical instrument and supporting surgery 
conducted with reference to picked up images of an 
affected part has: a manipulator capable of manipulating 
the surgical instrument; a surgical instrument operating 
means 1 controlling the manipulator; a surgical 
instrument sensor information measuring means 1 5 for 
measuring information from a sensor installed on the 
surgical instrument; a surgery support image generating 
means 8 for generating surgery support images on the 
basis of the sensor information measured; an affected 
part image pickup means 6; an image control means 9 for 
controlling and synthesizing each image; and an image 
display means 7 for displaying the images controlled. The 
surgery support images show the movable ranges of the 

surgical instrument and the manipulator capable of operating the surgical instrument 
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* NOTICES ♦ 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated 
3.1n the drawings, any words are not translated. 



[Claim 1] In the operation exchange equipment which supports an operation in case it has a 
surgical instrument and he undergoes an operation by referring to an affected part image pick-up 
image A surgical instrument actuation means to control an operational manipulator and this 
manipulator for said surgical instrument, A surgical instrument sensor information measurement 
means to measure the information from the sensor installed in said surgical instrument, An 
operation exchange image creation means to create an operation exchange image based on the 
measured sensor information, It is operation exchange equipment which has an affected piart 
image image pick-up means, the image control means which controls and compounds each 
image, and an image display means to display the controlled image, and is characterized by said 
operation exchange image showing the movable range of an operational manipulator for a surgical 
instrument and a surgical instrument 

[Claim 2] An operational manipulator is operation exchange equipment according to claim 1 
characterized by being the manipulator with which the tip is carrying out the configuration of a 
surgical instrument for said surgical instrument. 

[Claim 3] It is operation exchange equipment according to claim 1 characterized by an 
operational manipulator being a manipulator which can grasp a surgical instrument at the tip 
about said surgical instrument 

[Claim 4] Said operation exchange image is operation exchange equipment according to claim 1 
characterized by displaying a limitation when an operational manipulator is a limitation about a 
surgical instrument and a surgical instrument 

[Claim 5] The performance information of the surgical instrument in said operation exchange 
image is operation exchange equipment according to claim 1 characterized by what is displayed 
in piles on the image of the surgical instrument in the picturized affected part image. 
[Claim 6] The performance information of the surgical instrument in said operation exchange 
image is operation exchange equipment according to claim 1 characterized by avoiding and 
displaying the image for an operation. 

[Claim 7] The information on the relative distance to the surgical instrument in said operation 
exchange image and the candidate for an operation is operation exchange equipment according 
to claim 1 characterized by changing the method of presentation according to a motion of a 
surgical instrument 

[Claim 8] The retention span to the body of said surgical instrument is operation exchange 
equipment according to claim 5 characterized by what is displayed on a manipulator image with 
an indicator in piles. 

[Claim 9] It is operation exchange equipment according to claim 5 characterized by rotating a 
surgical instrument tip toward the extended direction of a surgical instrument according to the 
increment in an include angle when the angle of bend in the joint of said surgical instrument is 
expressed in a manipulator image as a mark in piles and the joint of a surgical instrument has not 



[Claim 10] It is operation exchange equipment according to claim 3 which displays the hand of 
cut of said whole surgical instrument on a manipulator image in piles by angle^of-rotation display. 



CLAIMS 



[Claim(s)] 



bent. 
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and is characterized by rotating a graduation according to rotation of a surgical instrument 
[Claim 1 1] The distance display from the tip of said surgical instrument to the brain table of the 
surgical instrument extension direction is operation exchange equipment according to claim 5 
characterized by displaying by the concentric circle from which a radius is different for every 
predetermined distance, and making it distance known by the number of circles when the surgical 
instrument has bent the include angle more than predetermined to the screen. 
[Claim 1 2] Operation exchange equipment according to claim 5 characterized by aligning ah 
endpoint with the tip of a surgical instrument, and the brain table of the surgical instrument 
extension direction, and attaching and displaying a graduation on the direction and 
perpendicularly a surgical instrument points out for every predetermined distance when the 
include angle to the screen perpendicular direction of said surgical instrument is more than 
predetermined. 



[Translation done.] 
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* NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This docunnent has been translated by computer. So the translation nnay not reflect the original 
precisely. . 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the operation exchange equipment for 

supporting an operation etc. 

[0002] 

[Description of the Prior Art] Since it says in recent years that there is little invasion (physical 
burden given to a patient in the cases, such as an operation) to a patient, the operation which 
uses the image information inside the bodies, such as an endoscope image, has spread, and the 
method of undergoing an operation using a detailed manipulator is developed. 
[0003] However, grasp of the distance of the screen depth direction or the location of a field of 
operation is difficult only from an endoscope image. Then, the equipment which supports an 
operation using the display means which creates the image information for supporting an 
operation and is piled up on an endoscope image is developed. 

[0004] Such a technique is indicated by JP,9-19441A JP.8-215211,A, etc. In JP.9-19441,A, the 
technique which creates the three-dimension image showing the solid configuration of an object 
part, carries out [ technique ] location adjustment, and is compounded on the image of the 
picturized affected part is indicated (it is called the conventional technique 1). Moreover, the 
technique of compounding the image information to which the image information and the surgical 
instrument of the picturized affected part express with JP,8-21521 1.A the relative relation of 
the stress, the surgical instrument, and the affected part which are exerted on the affected part, 
and the direction of a surgical instrument of operation is introduced (it is called the conventional 
technique 2). 
[0005] 

[Problem(s) to be Solved by the Invention] However, there is no designation of the information 
concerning the movable range of a surgical instrument with the above-mentioned conventional 
techniques 1 and 2. Therefore, way persons (medical practitioner etc.) did not find the spilling 
limit of a surgical instrument Moreover, neither the access to the part for an operation nor 
selection of a surgical instrument was considered to making incorrect and others there be 
nothing. Furthermore, with the above-mentioned conventional techniques 1 and 2, it was not 
taken into consideration to the point of hiding the image of the affected part which the operation 
exchange image picturized. 

[0006] By specifying the information about the movable range of a surgical instrument, the 
spilling limit whose way person is a surgical instrument understands the purpose of this 
invention, and it is to offer the operation exchange equipment with which mental stability into the 
trap is acquired by this. Other purposes of this invention are by specifying an actuation limitation 
to offer the operation exchange equipment which can be prevented from inputting the force in 
which an actuation way person exceeds a limitation, and destroying equipment 
[0007] The purpose of further others of this invention is to offer the operation exchange 
equipment which can prevent carrying out actuation mistaken by specifying the direction of a 
surgical instrument of operation. The purpose of further others of this invention is to offer the 
operation exchange equipment which can prevent mistaking selection of access and a surgical 
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instrument because a way person grasps an actuation limitation. 
[0008] 

[Means for Solving the Problem] In the operation exchange equipment which supports an 
operation in case he undergoes an operation by the configuration of invention concerning the 
operation exchange equipment of this invention referring to an affected part image pick-up image 
A surgical instrument actuation means by which a tip controls an operational manipulator and 
this manipulator for a surgical instrument, A surgical instrument sensor information measurement 
means to measure the information from the sensor installed in the surgical instrument. An 
operation exchange image creation means to create an operation exchange image based on the 
measured sensor information, Having an affected part image image pick-up means, the image 
control means which controls and compounds each image, and an image display means to display 
the controlled image, said operation exchange image shows the movable range of an operational 
manipulator for a surgical instrument and a surgical instrument. 

[0009] And an operational manipulator is operation exchange equipment according to claim 1 
preferably characterized by being the manipulator with which the tip is carrying out the 
configuration of a surgical instrument for said surgical instrument.. 
[0010] Moreover, it is operation exchange equipment according to claim 1 preferably 
characterized by an operational manipulator being a manipulator which can grasp a surgical 
instrument at the tip about said surgical instrument 

[0011] Said operation exchange image displays a limitation for a surgical instrument and a 
surgical instrument preferably further again at the time of the limitation of an operational 
manipulator. 

[001 2] The performance information of the surgical instrument in said operation exchange 
drawing is preferably displayed in piles on the image of the surgical instrument in the picturized 
affected part image further again. 

[0013] The performance information of the surgical instrument in said operation exchange image 
avoids and displays the image for an operation preferably further again. 
[0014] The information on the relative distance to the surgical instrument in said operation 
exchange image and the candidate for an operation changes the method of presentation 
preferably further again according to a motion of a surgical instrument. The retention span to the 
body of said surgical instrument is preferably displayed on a manipulator image with an indicator 
in piles further again. 

[0015] Preferably, when the angle of bend in the joint of said surgical instrument is expressed in 
a manipulator image as a mark in piles and the joint of a surgical instrument has not bent, a 
surgical instrument tip is rotated toward the extended direction of a surgical instrument further 
again according to the increment in an include angle. 

[0016] Preferably, the hand of cut of said whole surgical instrument is displayed on a manipulator 
image in piles by angle-of-rotation display, and a graduation is rotated further again according to 
rotation of a surgical instrument. 

[0017] Preferably, when the surgical instrument has bent the include angle more than 
predetermined to the screen, the distance display from the tip of said surgical instrument to the 
brain table of the surgical instrument extension direction is displayed by the concentric circle 
from which a radius is different for every predetermined distance, and distance understands it by 
the number of circles further again. 

[0018] Preferably, when the include angle to the screen perpendicular direction of said surgical 
instrument is more than predetermined, an endpoint is aligned with the tip of a surgical 
instrument, and the brain table of the surgical instrument extension direction, and a graduation is 
attached and displayed on the direction and perpendicularly a surgical instrument points out for 
every predetermined distance further again. 
[0019] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this invention is explained 
with reference to a drawing. Drawing 1 thru/or drawing 7 are the explanatory views of the 
operation exchange equipment concerning the first example of this invention, and drawing 1 
shows the operating condition at the time of the operation of operation exchange equipment 
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Drawing 2 shows the configuration and control action of operation exchange equipment Drawing 
3 is the external view of a manipulator. Drawing 4 R> 4 shows one example of an operation 
exchange image. Drawing 5 R> 5 is the explanatory view, of composition of an operation exchange 
image. 

[0020] In drawing 1 , the case where a surgical instrument is operated using a manipulator (robot 
arm) is assumed. 1 is a surgical instrument actuation means, a control lever is used, it is for 
operating actuation of a surgical instrument and a manipulator, and the way person 2 operates 
this. 3 is a surgical instrument control means and is built in in the illustration console. 4 is a 
manipulator, it is for operating detailed surgical instrument use, and self is also manufactured 
minutely. 5 is a patient and the manipulator 4 is located in a head opening part For an affected 
part image image pick-up means and 7, as for an operation exchange image creation means and 
9, an image display means and 8 are [ 6 / an image control means and 10 ] ecology internal 
information measurement means. 

[0021] The way person 2 inputs the surgical instrument actuation information 11 (referring to 
drawing 2 and a detail are mentioned later) into the surgical instrument control means 3 with the 
surgical instrument actuation means 1, inserting a manipulator 4 and referring to the image of the 
image display means 7 from a patient's 5 small opening part The surgical instrument control 
means 3 changes into the surgical instrument control information 1 2 (referring to drawing 2 and a 
detail are mentioned later) the surgical instrument actuation information 11 that it was inputted, 
outputs it to a manipulator 4, and controls actuation of a manipulator 4 and a surgical 
instrument 

[0022] Drawing 2 explains the configuration and control action of operation exchange equipment 
in more detail. 

[0023] A surgical instrument actuation means 1 to output the surgical instrument actuation 
information 1 1 for operation exchange equipment to operate both a manipulator 4 and a surgical 
instrument The surgical instrument control means 3 which outputs the surgical instrument 
control information 12 for controlling both a manipulator 4 and a surgical instrument based on 
this surgical instrument actuation information 11, A surgical instrument sensor information 
measurement means 15 to measure actuation of a surgical instrument and to output the surgical 
instrument sensor information 14, An operation exchange image creation means 8 to create an 
operation exchange image from the surgical instrument control information 12 and the surgical 
instrument sensor information 14, An affected part image image pick-up means 6 to picturize an 
affected part image and to output image information 16, An image living body internal information 
measurement means 1 0 to measure living body internal information and to output the interior 
image information 17 of a living body, or image information 16, It has the image control means 9 ■ 
which controls the image information 16 of the shoes to input and outputs the control image 
information 18, and an image display means 7 to display the control image information 18. 
[0024] Furthermore, each configuration means and contents of information are explained. The 
affected part image image pick-up means 6 is a means to picturize the image of the affected 
part with an endoscope, an electron microscope, a CCD camera, or other image image pick-up 
equipments. The image display means 7 is a means to display image information on the image 
display device of CRT, a head mount display, or others, or a means to display direct image 
information on a patient 

[0025] The operation exchange image creation means 8 is a means for the surgical instrument 
control information 12 and the surgical instrument sensor information 14 which control a 
manipulator 4 to be inputted, to change these input into a numeric value and an image, and to 
output image information. Moreover, it is a means to output the image information 1 6 which the 
interior image information 1 7 of a living body was inputted from a living body internal information 
measurement means 10 to mention later, and extracted and carried out marking of the image of 
a vital organ, and the image of the organ for an operation. 

[0026] After the image control means 9 extracts a display image from the inputted image 
information 16 and processes magnitude, it is a means to carry out location adjustment and to • 
compound. Under the present circumstances, it is considered so that the image of the affected 
part picturized in the affected part image image pick-up means 6 may not be hidden, and image 
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information is displayed on locations other than an affected part image. 

[0027] The living body internal information measurement means 10 is a means to picturize the 
tomogram for magnetic resonance diagnostic equipment (MRI), an X-ray computerized- 
tomography scanning equipment (CT) image, an ultrasonic image, nuclear medicine diagnostic 
equipment (RI), or others. 

[0028] In the surgical instrument control information 12 which controls the manipulator 4 which 
is one of the input at the time of creating an operation exchange image angle of rotation from 
the initial state of a manipulator 4 — a variation rate and a pivotable include angle — warning at 
the time of the limitation of angle of rotation, and the angle of bend of the joint from an initial 
state — a variation rate — They are information, such as warning at the time of the collision of 
warning at the time of the limitation of an include angle with a turnable Joint (include angle turn 
at a joint), and the angle of bend of a joint, the advancing^side-by-side migration length 
(distance which progressed in the direction of a tip) from an initial state, and manipulator 4 
comrades. Such image information 16 is created and it inputs into the image control means 9, 
and the control image information 18 is further inputted into the image display means 7, and it is 
displayed. 

[0029] In the surgical instrument sensor information 14 which is other one of the input at the 
time of creating an operation exchange image, they are information, such as stress applied at the 
distance of a surgical instrument and the affected part on a surgical instrument shaft- 
orientations production, contact at the tip of a surgical instrument, and the tip of a surgical 
instrument 

[0030] Drawing 3 shows one example of a manipulator, the manipulator 4 has projected out of 
the cylinder-like guide manipulator 19, and it is in the condition which can undergo an operation. 
[0031] Dra wing 4 shows one example of an operation exchange image, and assumes the place 
where the tip is performing an operation on the surgical instrument using three operational 
manipulators 4 (4A, 4B, 40). 

[0032] In order to control and display the image for supporting an operation, the operation 
exchange image creation means 8, the affected part image image pick-up means 6, the living 
body internal information measurement means 10, the image control means 9, the image display 
means 7, etc. combine, and are constituted. 

[0033] On the endoscope image picturized with the affected part image image pick-up means 6 
carried in the guide manipulator 19, the synthetic image 401 carried out location adjustment, and 
has piled up the information created with the operation exchange image creation means 8. At 
this time, location adjustment is performed by referring to the surgical instrument control 
information 12 outputted by the surgical instrument control means 3. Or an image processing 
performs. The image which becomes hard to see when it piles up with the image of the affected 
part by the ultrasonic image 402 picturized with the living body internal information measurement 
means 10 presses down the range in which the image of the picturized affected part is hidden to 
the minimum, and displays it on screen edges, such as the location which can be seen without 
the way person 2 moving a look as much as possible, for example, the upper left section etc. For 
the same reason, the navigation image 403 which expressed the location of the surgical 
instrument in a field of operation with the mimetic diagram is displayed on screen edges, such as 
an upper right portion. The navigation image 403 is created with the operation exchange image 
creation means 8 based on images picturized with the living body internal information 
measurement means 10, such as MRI and CT. Modification of the magnitude of a window, a 
display location, a display, and un-displaying of the ultrasonic image 402 or the navigation image 
403 is enabled. 

[0034] The synthetic image 401 shown by drawing 5 shows one example which carried out 
location adjustment and piled up the image created with the operation exchange image creation 
means 8 by the image control means 9. That is, the operation exchange image 413 about an 
organ is created by the operation exchange image creation means 8, the living body internal 
information measurement means 10, and the image control means 9, the operation exchange 
image 414 about a surgical instrument is similarly created by the operation exchange image 
creation means 8 and the image control means 9, and the affected part Image 415 is created by 
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the affected part image image pick-up means 6 and the image control means 9, and is 
compounded and displayed on the image-display means 7, respectively. 

[0035] Among the synthetic images 401 shown by drawing 4 , 404, 405, and 412 are the images 
about an organ, are an image on the operation exchange image 413 shown by drawing 5 , and 
show the example of the operation exchange image about an organ. The image which extracts 
and carries out marking of a vital organ 404 and the organ 405 for an operation, more nearly 
respectively than the image information obtained with the living body internal information 
measurement means 10, and the navigation image information 412 which shows the direction of 
the organ 405 for an operation on the basis of the brain table on the shaft-orientations 
production of a surgical instrument (brain front face) are shown. 

[0036] The operation exchange image about a surgical instrument is created by the surgical 
instrument sensor information measurement means 1 5, the operation exchange image creation 
means 8, the image control means 9, the image display means 7, and the surgical instrument 
control means 13. 406 later mentioned among the synthetic images 401 thru/or 411 are the 
images about a surgical instrument, is an image on the operation exchange image 414 shown by 
drawing 5 , and shows one example of the operation exchange image which displays surgical 
instrument information. 

[0037] The operation exchange image about a surgical instrument is created based on the 
surgical instrument control information 12 and the surgical instrument sensor information 14. 
Moreover, the operation exchange image about a surgical instrument makes the minimum the 
range in which the image of the affected part is hidden, and is displayed intelligibly for the 
location for which an operation can be conducted, without if possible a way person moving a 
look. 

[0038] Below, each information display is explained. The retention span to the body of a surgical 
instrument is displayed on the retention span indicator 406. when a body is contacted, a one- 
eyed indicator lights up green, the level of an indicator goes up according to the strength of a 
retention span, and when it becomes the strength which can be grasped, the color of the whole 
indicator is alike and changes. Since need frequency is low compared with the angle-of-rotation 
display and angle-of^bend display which are mentioned later, the retention span indicator 406 is 
displayed on the root side of a manipulator 4 (4A, 4B, 4C). 

[0039] The angle of bend in the joint of a surgical instrument is displayed on the center section 
of the manipulator 4 (4A, 4B, 4C). The angle of bend of a joint is expressed as an arrow head 
(mark) in a circle, as shown in the angle-of^bend display 407. The inclination of an arrow head 
shows the direction of crookedness, and the degree of an angle of bend. When the joint of a 
surgical instrument has not bent, the surgical instrument tip is turned to in the extended 
direction of a surgical instrument Therefore, when the angle of bend of a joint is 0 degree 
(degree) in a display, the direction of an arrow head is turned to in the extended direction of a 
surgical instrument, and is rotated to a clock and an opposite direction according to the 
increment in an include angle. 

[0040] The hand of cut of the whole surgical instrument is displayed on the angle-of~rotation 
display 408. A graduation is expressed as a negative-number character every 20 degrees to a 
rotation limitation in the time of rotating the time of rotating according to rotation of a surgical 
instrument and rotating in the direction of a right screw to forward and hard flow. The number of 
angle of rotation reads the figure of the middle of a graduation. Since need frequency of angle of 
rotation is high, it is displayed on the tip side of a surgical instrument that it does not interfere 
with the image of the affected part so that the way person 2 may be seen without moving a look. 

[0041] In the method of presentation of a graduation like a ruler, the distance display from the 
tip of a surgical instrumerit to the brain table of the surgical instrument extension direction has 
an unclear distance of a screen perpendicular direction, and while bending the joint to the screen 
perpendicular direction for this reason, it cannot display distance. Moreover, a graduation will lap 
with an include angle. Therefore, even if an include angle changes, it displays by the concentric 
circle from which a radius is different for every predetermined distance like the first distance 
display 409 (manipulator 4AX and is made for distance to be known by the number of circles so 
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that a relative distance with a brain table can be displayed according to it when the surgical 
instrument has bent the include angle more than predetermined to the screen. At this time, the 
core of a circle expressed with x mark is the extended direction of a surgical instrument, and is 
also a brain table. When the include angle to the screen perpendicular direction of a surgical 
instrument is more than predetermined, a graduation like a ruler shakes, the direction is more 
intelligible, since graduations do not lap, an endpoint is aligned with the tip of a surgical 
instrument (406 shows), and the brain table of the surgical instrument extension direction like 
the second distance display 410 (manipulator 4B), and a graduation is attached and expressed to 
the direction and perpendicularly a surgical instrument points out for every predetermined 
distance. At this time, the die length of the starting point part of the graduation which laps with 
the tip of a surgical instrument is lengthened, and the brain table of the surgical instrument 
extension direction is expressed with x mark. 

[0042] When angle of rotation, the angle of bend of a joint, and advancing-side-by-side distance 
are limitations, or when there is possibility of the collision with other surgical instruments, it is 
indicated like the 'oscillation limitation" (manipulator 4A) of the warning alphabetic character 
411, or an "advancing^side-by-side limitation" (manipulator 4C) that the way person 2 does not 
apply the force beyond the need to the surgical instrument actuation means 1. 
[0043] Drawing 6 is what carried out location adjustment with other image information, and piled 
up other examples of the operation exchange image about surgical instrument information by the 
image control means 6, and assumes the place where the tip is performing an operation on the 
surgical instrument using three operational manipulators. 

[0044] surgical instrument information — angle of rotation from the initial state of a manipulator 
— a variation rate and a pivotable include angle — vyarning at the time of the limitation of angle 
of rotation, and the angle of bend of the joint from an initial state — a variation rate — The 
surgical instrument control information 12, such as warning at the time of the collision of warning 
at the time of the limitation of an include angle with a tumable joint (include angle turn at a 
joint), and the angle of bend of a joint, the advancing-side-by-side migration length (distance 
which progressed in the direction of a tip) from an initial state, and manipulators. The surgical 
instrument sensor information 14, such as stress applied at the distance of a surgical instrument 
and the affected part on a surgical instrument shaft-orientations production, contact at the tip 
of a surgical instrument, and the tip of a surgical instrument, is measured. 
[0045] The retention span indicator 406 is perpendicularly displayed on the root side on the 
image of a manipulator to a shaft so that the image of the affected part picturized if possible 
may not be hidden. Moreover, the retention span indicator 406 is displayed on the fixed location 
to the display of angle of rotation or an angle of bend moving with migration of a surgical 
instrument so that the distance (it moved in the direction of a tip) with which the surgical 
instrument kept pace may be known. The angle of bend in the joint of a surgical instrument is 
displayed with the inclination (inclination to the shaft of the root of a surgical instrument) to the 
retention span indicator 406 of the angle-of-rotation range 501. When an angle of bend is 0 
degree as the direction of the ellipse minor axis of the angle-of-rotation range 501 always 
expresses the direction of a tip, the ellipse minor axis of the angle-of-rotation range 501 and the 
direction of the retention span indicator 406 are made the same, and when an angle of bend is 
90 degrees, the ellipse major axis of the angle-of-rotation range 501 and the direction of the 
retention span indicator 406 are made the same. 

[0046] The pivotable range of a surgical instrument is displayed on the angle-of-rotation range 
501. It always displays on a surgical instrument tip side (neighborhood), and the angle-of-rotation 
range 501 makes 0 degree the point of the shape of an ellipse of the direction of an ellipse minor 
axis, and the direction of an image core in an initial state, it distinguishes the right-and-left 
pivotable range with a color, and displays it The surgical instrument on the right-hand side of 
drawing assumes the case where it is pivotable **45 degrees. When it comes to the limitation of 
angle of rotation, the color distinguished by different color with is changed to a color different 
from an initial state. Moreover, angle of rotation is expressed as an arrow head 502 on the angle- 
of-rotation range 501. By this display, a way person understands the allowances to a rotation 
limitation at a glance. 
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[0047] The distance which carried out advancing^side-by-side migration is displayed with the 
distance between the retention span indicators 406 currently displayed at least on the angle-of- 
rotation range 501 always displayed at least on the point, and an image edge fixed part 
[0048] It is displayed on the monitor on the image of a surgical instrument, or besides an 
endoscope image so that the operation exchange image about a surgical instrument may bar the 
image of a field of operation, may twist and may be beneficial. 

[0049] Drawing 7 is what carried out location adjustment with other image information, and piled 
up the example of further others of the operation exchange image about surgical instrument 
information by the image control means 9, and assumes the place where the tip is performing an 
operation on the surgical instrument using three operational manipulators. The surgical 
instrument sensor information 14 is displayed out of an endoscope image so that the image of 
the picturized affected part may not be hidden. Here, it is expressing as the gestalt which can be 
displayed easily out of an endoscope image about some sensors chosen from the surgical 
instrument sensor information 14. 

[0050] With reference to drawing 8 and drawing 9 , the second example of this invention is 
explained below. Drawing 8 is drawing showing other examples of operation exchange equipment 
Drawing 9 is a block diagram corresponding to other examples of the operation exchange 
equipment shown by drawing 8 . In drawing 8 and drawing 9 , the case where a way person 
performs an operation using the surgical instrument 601 with a surgical instrument information 
measurement function is assumed. 

[0051] An operation is conducted using the surgical instrument sensor information measurement 
means 15, the operation exchange image creation means 8, the affected part image image pick- 
up means 6, the living body internal information measurement means 10, the image control 
means 9, and the image display means 7. 

[0052] The way person 2 inserts the affected part image image pick-up means 6 and the surgical 
instrument 601 with a surgical instrument information measurement function in a patient 5 from 
small opening, and performs an operation by referring to the image of the image display means 7. 
[0053] The operation exchange image in the case of undergoing an operation using the surgical 
instrument 601 with a surgical instrument information measurement function can use the same 
image as the case where an operation is undergone using a manipulator 4. However, \n the 
operation exchange image about a surgical instrument 601, the information about the angle-of- 
bend display 407 of a joint, the angle-of-rotation display 408, or a motion peculiar to an 
equivalent manipulator is removed. 

[0054] According to this example, the following effectiveness is acquired as explained above. It is 
made for the spilling limit whose way person is a surgical instrument by specifying the 
information about the movable range of a surgical instrument to ^M^sMc jn the first place, and 
mental stability into the trap is acquired by this. It can prevent from inputting the force in which 
a way person exceeds an actuation limitation by specifying an actuation limitation, and 
destroying exchange equipment to the second. It can prevent carrying out actuation which the 
surgical instrument mistook by third specifying the direction of a surgical instrument of 
operation. It can prevent mistaking selection of access and a surgical instrument because a way 
person grasps an actuation limitation to the fourth. 



[Effect of the Invention] As explained above, according to this invention, by specifying the 
information about the movable range of a surgical instrument it is made for the spilling limit 
whose way person is a surgical instrument to be known, and mental stability into the trap is 
acquired by this. Moreover, it can prevent by specifying an actuation limitation from inputting the 
force in which a way person exceeds an actuation limitation, and destroying exchange equipment 
It can prevent carrying out actuation which the surgical instrument mistook by specifying the 
direction of a surgical instrument of operation further again. It can prevent mistaking selection of 
access and a surgical instrument further again because a way person grasps an actuation 



[0055] 



limitation. 
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* NOTICES ♦ 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 



1. This document has been translated by connpLrter. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is an explanatory view at the time of use of the first example concerning the 
operation exchange equipment of this invention. . 

[Drawing 2] They are the configuration of the example of drawing 1 , and the explanatory view of 
a control action. 

[Drawing 3] It is structural drawing of a guide manipulator. 

[Drawing 4] It is drawing showing one example of an operation exchange image. 

[Drawing 5] It is drawing showing image composition of an operation exchange image. . 

[Drawing 6] Location adjustment is carried out with image information, and other examples of an 

operation exchange image are piled up. 

[Drawing 7] It is what carried out location adjustment with image information, and piled up the 
example of further others of an operation exchange image. 

[Drawing 8] It is an explanatory view at the time of use of the second example concerning the 
operation exchange equipment of this invention. 

[Drawing 9] They are the configuration of the example of drawing 8 , and the explanatory view of 
a control action. 
[Description of Notations] 

1 — Surgical instrument actuation means 

2 — Way person 

3 — Surgical instrument control means 

4 — Manipulator 

5 — Patient 

6 — Affected part image image pick-up means 

7 — Image display means 

8 — Operation exchange image creation means 

9 — Image control means 

10 — Living body internal information measurement means 

11 — Surgical instrument actuation information 

12 — Surgical instrument control information 

14 — Surgical instrument sensor information 

15 — Surgical instrument sensor information measurement means 

16 — Image information 

17 — Interior image information of a living body 

18 — Control image information 

1 9 — Guide manipulator 

401 — Synthetic image 

402 — Ultrasonic image 

403 — Navigation image 

404 — Vital organ 

405 — Organ for an operation 

406 — Retention span indicator 
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407 — Angle-of-bend display of a joint 

408 — Angle^of-rotation display 

409 — The first distance display 

410 — The second distance display 

41 1 — Warning alphabetic character 

412 — Navigation image information 

413 — Operation exchange image about an organ 

414 — Operation exchange image about a surgical instrument 

415 — Affected part image 

416 — Surgical instrument 
501 — Angle-of-rotation range 

601 — Surgical instrument with the information measurement function of a surgical instrument 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This docunnent has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DRAWINGS 



[Drawing 1] 
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[Drawing 3] 
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[Drawing 6] 
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[Drawing 9] 
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